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(54) Connpact digital camera with segmented fields of view 



(57) A compact digital camera is formed with a lens- 
let array comprised of a plurality of lenslets, each lenslet 
has a decentration corresponding to its radial position in 
the lenslet array so that the axial ray of each lenslet 
views a different segment of a total field of view. A pho- 
tosensor anray comprised of a plurality of sub-groups of 



photodetectors is positioned such that each sub-group 
is located along the axial ray of a respective lenslet. A 
field limiting baffle comprised of at least one aperture 
plate is positioned such that the center of the apertures 
are located along the axial ray of a respective lenslet. 
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Description 

Cross-Reference To Related Applications 

5 The present application is related to U.S. Application Serial Number 08/652,735, fOed May 23, 1996, entitled, "A 
Diffractive/Refractive Lenslet Array," by Mark M. Meyers; US. Application Serial Number 08/699,306, fUed August 19, 
1996. entitled. ^Compact Image Capture Device, "by Mark M. Meyers; and US. Applicatton Serial Number 08/720.282! 
filed September 26. 1996. entitled. "Compact Image Capture Device With Local Image Storage." by Mark M. Meyers. ' 

10 nELDOFTHglMygMTlOM 

The invention relates generally to the field of digital cameras and more particularly to an inproved image sensor 
with a lenslet array, having a smaller number of lenslets and a larger number of photodetectors per lenslet than here- 
to-fbre used, along with associated electronics being inserted in the unused spaces between spaced apart sub-groups 
IS of photodetectors 

BACKGROUND OF THE INVENTION 

Lenslet arrays have been used to concentrate light, imaged on a photodetector plane by a photographic objective, 
20 into smaller areas to allow more of the incident light to fall on the photosensitive area of the photodetector an^ and 
less on the insensitive areas between the pixels. This has been described in papers such as "Visible Array Detectors" 
by Timothy J. Tredwell, from HANDBOOK OF OPTICS, VOL 1, FUNDAMENTALS. TECHNIQUES. & DESIGN. SEC- 
OND EDITION, Chapter 22. pp. 32-34. These lenslet arrays are centered directly above the corresponding photosensor 
and are not designed to look at different portions of the field of view independently Rather, th^ concentrate the light 

25 from an existing Image, formed by the photographic objective, into the pixel aperture. 

In US. Patent No. 4.994.664, entitled. ''Optically Coupled Focal Plane Arrays Using Lenslets And Multiplexers "by 
Veldkamp. an array of diffractive lenslets is used to concentrate incident light onto an array of photosensors in order to 
allow for location of amplifying circuitry in areas between photosensor sites. These lenslets are centered over the pho- 
tosensitive sites and are formed on the opposite side of the photosensor anray on a silicon substrate, the use of the sil- 

.30 icon substrate prevents them from imaging visible light onto the photosensors since silicon dbes not transmit in the 
visible wavelengths. That invention is not be able to work over the visible wavelength range since the element is com- 
posed of all diffractive optical power and suffers from severe chromatic aberrations. 

In U.S. Patent No. 5,233.174. entitied. "V^fevefront Sensor Having A Lenslet Array As A Null Corrector" by Zmek. 
teaches an an-ay of diffractive lenslets with decenters that are adjusted to eliminate the local monochromatic wavefront 

35 tilt from a specific optic under test in an interferometric or Hartman type test. A Hartman test is used to certify the sur- 
face quality of various optics. If the optics under test falls within tiie acceptance criteria, the wavefront incident on the 
sensor array will form centered light spots on predetermined pixels. If the wavefront is other than the desired wavefront, 
the light spots will be incident on different pixel elements. That invention is not applicable to the cun-ent invention since 
the centered lenslets are not looking at angularly displaced sections of a larger field of view. It is also not applicable to 

40 white light applications due to the chromatic aben'ations of the diffractive lenslets. 

U.S. Patent No. 5,340,978. entitied, "Image-Sensing Display Witii LCD Display Panel And Photosensitive Element 
Array" Rostoker et al.. briefly descrtoes an anay of decentered lenses which form an image of a segment of the field of 
view. These lenses are widely separated and do not include a method for limiting a field of view seen by a group of pix- 
els. The use of the widely separated pixels win greatiy increase costs of the sensor since tiiere will be fewer sensor 

45 arrays fabricated on a given size substrate or wafer whch will cause a decreased yield of finished sensor an^ys for a 
given manufacturing process. There is no discussion of the trade-off between the focal length of the lens array and the 
angular subtense of the pixel's field of view. If the focal length of the lenslets is too short, light from one angular location 
which is incident on one group of pixels will also be within the field of view of an adjacent group. For very short focal 
lengths the con-esponding pixel dimension required for an equivalent angular resolution will be so small as to not be 

50 able to be fabricated with lithographic processes. If the pixel dimension is reduced too much the light gathering area of 
the pixel will be so small as to not generate a reliably measurable number of electrons for a given incident intensity. Ros- 
toker does not envision the use of diffractive/irefractive hybrids for achromatization. That patent uses an an'ay of uni- 
formly shaped lenslets, whUe in the present invention the utility of varying the surface prof He of the lenslets as a function 
of their radial position in the lenslet array allows for a higher level of aberration correction at any given location. In ttie 

55 current invention the lenses are abutted to each ottier and an opaque baffle is placed over the photodetector to limit ttie 
field of view of each pixel. The referenced patent uses one lenslet per group of three color pixels. In ttie current invention 
it is shown to be advantageous to form a small array of pixels for each lenslet if the focal lengtfi of each lenslet is 
adjusted appropriately (increased). 
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The invention disclosed in US. Patent No. 5.471.515. to Fossum. et al., entitied "Active Pixel Sensor with Intra- 
Pixel Charge Transfer. " converts the photogeneraled charge stored under the phologate of a semiconductor photosen- 
sor into a voltage by transfen-ing the charge to a sense node (typically a capacitor) located within the active pixel unit 
cell. Fossum then utilizes dual sample conrelated doutsle sampling of the voltage based signal to reduce signal noise 

5 and eliminate the effect of dark cun-ent from the photosensor. The voltage associated with the image exposure is then 
subtracted from the voltage associated with a read during a dark sample by a voltage differencing amplifier located at 
the end of the row or column of the photosensors. By using appropriate row and column select data lines, a subsection 
of the array can be read out without the need to read out the entire image array The Fossum invention does not how- 
ever enable an increase in the overall sensitivity of the photosensor (CCD detector) elements, nor does it envision the 

10 utilization of an array optic type structure to form an image of different segments of a field of view, although the patent 
does disctose the use of a lens an^y for concentrating light on the active pixel. Fossum is performing most of the signal 
processing in a voltage amplification mode, whereas the present invention utilizes tiie advantages of a cun-ent mode 
signal processing. In addition, the present invention provides for tiie digitization and storage of tiie digital image data at 
each photosensor site. 

15 In US. Patent No. 5.004.901. entitled "Current Minror Amplifier for use in an Optical Data Medium Driving Appara- 
tus and Servo OrcuH * by Yoshimoto. et at., a photogenerated cun-ent from an optical disk tracking and read sensor is 
anrplif led in fixed steps by a switchable series of current mtnrors where ttie current mirrors achieve current multiplication 
through the use of output stages that incorporate a'ther multi'ple output transistors with the bases of tfie output transis- 
tors connected in parallel, or by the use of output transistors with emitter areas that are integral multiples of the emitter 

20 areas of the input side transistor. The purpose of Vbshimoto's invention is to allow the utilization of received photocur- 
rents with a large dynamic range by multiplying tiie input current by an adjustable ratio where tiie multiple current ratios 
are selected through a SAritchable network of differential amplifiers. Yoshimoto's invention is not related to the field of 
array image sensors and requires the use of a switchable an^ay of differencing amplifiers. Yoshimolo's invention does 
not integrate the current from the photosensor and the cun^ent is continuously generated by received light from the laser 

25 light emitted by the optical disk head. The sensor is not exposed to an Image as in the cun-ent invention, but is used in 
a continuous optical disk position monitoring mode. Yoshimoto does not utilize dual slope con'elated double sarrpling 
for noise reduction as disclosed in the present invention. Yoshinwto does not make any mention of the use of anray 
optics witii a f ieki of view which varies as a function of radial positton in tiie sensor anray 

30 Summary Of the Invention 

The present invention Is directed to overcoming one or more of the problems set forth above. Briefly summarized, 
according to one aspect of the present inventfon there is provkled a compact digital camera, comprising: 

35 a lenslet array comprised of a plurality off lenslets, each lenslet having a decentration corresponding to its radial 
position in the lenslet array so that the axial ray of each lenslet views a different segment of a total field of view; 
a photosensor anray conrprised of a plurality of sub-groups of pholod^eclors, each sub-group positioned along the 
axial ray of a respective lenslet; and 

a field limiting baffle comprised of at least one aperture plate where the center of the apertures are positioned to 
40 lie akmg the axial ray of a respective lenslet 

Advantageous Efttect of The inverttton 

The present invention has the following advantages: 
45 An extremely conrpact digital camera wrth a lenslet array in dose proximity to a photodetector array is formed. Due 
to the larger sub-image size a reduced number of lenslets are needed to construct tiie full image. By utilizing the space 
between sub-groups of photodeteclors for signal processing electronics, the digital camera can be formed on a single 
substrate. In addition, a large high resolution sensor can be syrthesized by the use of sub-groips of photodetectors. 

so BRIEF DESCRIPTION OF THE DRAWINGS 

Figs. 1 A and 1 B are, a top view of lens contours and baffles for tiie lens array, and a block diagram of a photode- 
tector array incorporating the unit pixel subassen^ies and associated memories at each site, and an exploded 
view of a portion of the an'ays of Fig. 1 A. respectively; 

55 

Fig. 2 is a sectioned view taken along the section lines A-A of the lens anay of Fig 1 A; 

Figs. 3A. 3B. and 3C. illustrate in cross section a central lenslet and the associated tangential and sagittal ray aber- 
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ration curves, respectively; 

Figs 4A. 4B, arxl 4C. Illustrate in cross section a lenslet at a 16 degree field angle and the associated tangential 
and sagittal ray aberration curves, respectively; 

5 

Figa 5A. 5B, and 5C, fllustrale in cross section a lenslet at a 26 degree field angle and the associated tangential 
and sagittal ray aberration curves, respectively; 

Rg. 6 is a scheniatic diagram of one unit photodeteclor element of a sub-group connected to common circuits and 
w used in a device such as a camera to capture an image: 

Fig. 7 is a circuit diagram of an alternate embodiment of common circuits that may be used with the unit photode- 
tector elements forming a sub-group of photodetectors; 

15 Fig. 8 is a circuit cfiagram of another alternate embodiment of common circuits that may be used with the unit pho- 
todetector elements forming a sub-group of photodetectors; and 

Fig. 9 is a pictorial representation of the operation of a portion of the compact digital camera with segmented fields 
of view. 

20 

To facilitate understanding, identical reference numerals have been used, where possible, to designate identical 
elements that are common to the figures. 

DETAILED DESCRIPTION OF THE INVENTION 

2S 

Referring to Figs. 1 A and 1 B, a lenslet array 10 is formed with an an-ay of achromatized refractive/drffractive lenslets 
12 or refractive lenslets which are centered over sub-grotps 22 of photodetector 24 formed into a photosensitive array 
20 (shown more dearly in the section view of Rg. 2). To be observed in Fig. 1 A Is that the center of the mechanical opti- 
cal axis 14 of each lenslet 12 is displaced relative to the fixed sensor-to-sensor distance as a function of its radial <fis- 

30 tance from the optical axis of the central lenslet. The lines 15 appearing around the mechanical optical axis 14 of each 
lenslet 12 are topographical lines indicating changes In height of the lenslet's surface. An opaque mask 1 6 fills the areas 
between the lenslets 12 to prevent light that would by-pass the lenslets from reaching the photosensitive array 20. The 
lenslet array 10, depicted in Rg. 1 A represents only a small portion of an anay that will be used in an actual camera. In 
an actual implementation approximately 150X100 lenslets are used to form tfie lenslet array 10 each having an associ- 

35 ated sub-group of photodetectors 22 formed with 1 0x1 0 photodetector elements 24. 

In order for the lenslet array 1 0 to see different fields of view, the optical axis 1 4 of the lenslets 1 2 in the lenslet array 
10 are located at a distance which becomes progressively larger than the center-to-center dstance of the sub-groups 
of photodetectors 22 In the photosensor array 20. The displacement of the lenslets optical axis 14 increases radially 
from the center of the lenslet array 10. Decentering a lensleffe optical axis tends to bend rays from off-axis field angles 

40 Irrto the center of the lenslet's field of view. By moving the optical axis of tiie lenslet further out radially with increasing 
distance from the center of the lenslet array 10, the angular location of an object at the center of the field of view for a 
given lenslet^b-group of photodetectors originates from Increasingly off-axis segments of the total field of view (shown 
more clearly in Rg. 2). 

For Instance, the required decenter for a lenslet of focal length FLj necessary to deflect a r^ from the desired field 
45 angle Into the center of the lenslets associated sub-group of photodetectors 22 can be detennined from the paraxial ray 
tradng equations. The paraxial equations are 

y' = yo + nu(t/n) 

so n'u' = noUo-y<^ 

where 

y* ° height after propagation to next surface 

55 

yo » height at prevfous surfece 
u ^ paraxial slope angle (radians) 
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Uo = slope angle before refraction 

^ o power of lenslet (^s 1/f) 

n = refractive index of the lenslet's medium 

Therefore, the displacement d for a given lenslet with power ^ (where ♦ = 1/f ) that is necessary to bend the central 
ray from a given angle of incidence Uo to a desired angle u\ after refraction is given by 

d = yo(noUo-n'u)/f 

where 

f = focal length of the lenslet 

The invention utUizes an array of lenslets where the local displacement d of each lenslef s optical axis varies as a 
function of its radial position r relative to the optical axis of the lenslet positioned in the center of the lenslet array so 
that, to first order 

d{r) = (noUo(r)-nV(r))/f 

The invention consists of adjusting the lenslet decenters so that u'(r) = 0 for tiie central ray within a given lenslet's 
field of view (see Rg. 2). In this case the decenter necessary for a given lenslet is approximately a linear function of the 
lenslet's radial distance from the center lenslet's optical axis. 

Each sub-group of photodetectors 22 may be provided with associated array electronics dispersed in the open 
spaces on or in a supporting substrate 100. The array electronics may contain a multiplexing and clocking circuit 80, 
current mirror 30. a con-elated double sampling circuit 40, an analog-to-digital converter 56, a sub-image pixel inverter 
48, and a non-volatile memory cell 58. Each sub-group of photodetectors 22 is attached to a data bus 50 in response 
to signals from a row address decoder 60 and a column address decoder 62. Fig. 1 B illustrates a preferred positioning 
of green, blue, and red photodetector elements 24 for a color sensitive anray.. 

Referring now to tiie aoss-section view of Rg. 2, the lenslet an-ay 1 0 is positioned over a photosensor array 20 that 
may be a CCD array having a number of sub-groups of photodetectors 22 corresponding in number to at least the 
nun*er of lenslets 1 2 forming tine lenslet array 1 0. In a three color environment up to one third of the photodetector ele- 
ments 24 in each sub-group of photodetectors 22 would be provided witii a given color filter (red, green, or blue). The 
lenslet an-ay 10 is maintained a distance apart from the surfaces of tiie photodetector elements 24 by spacers 70 that 
may also serve tiie function of being baffles. The opaque masks 16 on tiie lenslet aray 10 combined with a field stop 
aperture plate 72 limits tiie field of view of any particular sub-group of photodetectors 22 so that it does not overlap the 
field of view of it neighbors by a large amount. The field stop aperture plate 72 is positioned approximately 0.5mm to 
3mm from the surface of the lenslet array 10. The field stop aperture plate 72 may be a layer of dear glass having an 
opaque mask pattern formed on one of it's surfaces. 

The center of ttie apertures in ttie aperture plate 72 are aligned to the center of tiie field of view of a corresponding 
lenslet. The spacing of the centers increases as a function of each lenslet's radial position radially from tiie center of 
the lenslet array causing tt)e aperture plate to be sllghtiy larger than the associated lens array. The combination of tiie 
opaque masks 1 6 with the aperture plate 72 and a given lenslet fbcal lengtti determines the field of view for a sub-group 
of photodetectors 22. The lenslet array 10 can be formed of etched quartz, injection molded plastic, or an epoxy replica 
on a glass substrata 

The lenslets 12, combined witii ttie appropriate field slop aperture plate 72, form Images of a small segment of tiie 
field of view on each sub-group of photodetectors 22. By forming ttie lenslets 12 with decentrations of the mechanical 
optical axis 14 which increase radially across ttie CCD array, ttie angle ttie axial ray (which is incident on a respective 
sub-group of photodetectors), makes with ttie surface normal to ttie photosensor array 20 will Increase as a function of 
ttie radial position of a sub^jroup of photodetectors 22 wltti respect to ttie center of the photosensor array 20. Therefore, 
appropriately adjusting the decenters of each lenslet assodated with a sub-group of photodetectors will allow ttie sub- 
group of photodetectors to view a different segment of a scene. The sub-images from each sub-group of photodetectors 
will be digitally inverted and stitched wltti ttie ottier sub-images to form a composite image as will be explained in ttie 
discussion of Rg. 9. Therefore, any camera system incorporating the present invention can be exto^emely compact and 
flat. The camera can work in black and white or In color if color filters are used on an appropriate nurrter of photode- 
tector elements in ttie sub-group of photodetectors. «^ 

An an'ay of refractive aspheric lenslets can also be used to form images on tiie photosensor array. However, ttie 
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aforementioned enibodiment does not conred for the variation in focal length as a function of wavelength since the lens 
element Is fonned from a single refractive material, therefore the spot size of the inckJent light varies as a function of 
color. An improved optical design, including a diffractive/irefractive hybrid lens is used to correct the chromatic aberra- 
tion in a single material. 

5 The imaging properties of diffractive optics are strongly wavelength dependent. When modeling a diffractive optic 
this phenomena can be represented as a direct dependence of equivalent refractive index on wavelengtti: 

n(X)=[X^](n,-1)-l 

10 Diffractive elements impart all of tiieir wavefront bending in an extremely tiiin layer. This is accounted for in the 
Sweat model by nrxxJeling the diffractive surface as a very high index material (nc = 10,000) witii very low curvatures 
(weak surfaces) on each surface. The corresponding focal length can ttien be determined from: 



f[X) = [n(X)-1]Ac 
so that 

f(X)«(X^X)fc 

20 where 

X6=design center wavelength 



The Sweat model is disclosed in "Designing and Constructing Thick Hotographfc O^rtical Elements." by W.C 
25 Sweat Applied OptiCS/vol. 17, No. 8, April 15. 1978. pp. 1220-1227. 
The resultant dispersion y^^^ of the diffractive element is: 



which reduces to: 



n(Xj-l 
'-'« = n(X3)-n(XL) 



For designs using: 

40 Xc e 587 nm 

Xg = 486 nm Vd = -3.5 
XL = 656nm 

For ottier wavelength bands of interest an appropriate Vj,i„ , and element power distribution can be calculated. The 
45 direct dependence of the equivalent refractive Index on wavelength leads to a small, negative v^m .and a high le^el of 
wavelength dispersfon associated with a first order (m = 1) diffractive optical element. 

Due to the variation of refractive index with wavelength, a single element lens has a variation of focal length with 
wavelength. Two materials with different dispersions can be used to form a doublet lens which has the same focal lengtti 
at two wavelengths and reduced variatfon over the whole spectaim. The relative distribution of focal powers required to 
50 achieve this is given by 

. ^ ret total 

55 

1 ^ ^diff*4' total 
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The negative v^Hf of the diffractive surface allows for achromatization of single element hybrid refractiveWiffractive 
lenses utilizing a positive focal length diffractive and refractive component. It also decreases the focal length and F/# 
required of the double component lenses, because a refractive doublet consists of a positive crown (low dispersion) 
lens with a shorter focal length and smaller F/# than is required for a singlet with an equivalent focal length, and a neg- 
ative f Ont element which increases tfie doublet focal length to the correct value and compensates for the dispersion of 
the positive lens. This effect also decreases tfie size and weight of ttie positive element of a hybrid refractiveWiffractive 
element. 

For traditional achromatization in the visible spectrum (d-e-f lines) wrtti PMMA plastic lenses, the fraction of power 
in the refractive and diffractive portions would be 

*ref/4»total = 94.25% 
*diff /<l>total = 5.75% 

IS It is Obvious to a person skilled in ttie art ttiat one can fabricate the lens array as a quartz master, an epoxy replica 
on a glass substrate, or as an injection molded part 

The use of diffractivefrMractive hybrid achromatization enables tiie use of cfiffractive surfaces with longer focal 
lengths and higher F/iTs. The high F/# makes the diffractive element easier to manufacture due to tiie large zone spac- 
ings. For instance, for a lens witii a FL = 3.0 mm and a Fy# = 2.0 the first order analysis of the refractive and diffractive 

20 portions wouki provkJe focal lengtiis and F/rs of 

frei = 3.18mm F/#=:2.12 
fdB,=52.2mm F/# = 34.8 



25 



30 



Assuming the diffractive portion of tiie lenslet was used purely for first order chromatic con-ection. 

The diffractive lenslets 12 are shown in Rgs. 3A. 4A, and 5A, for the on-axis. 16 degrees, and full fieki of view. To 
be noted in a comparison of tiiese figures is that the mechanical optical axis 14 Is moving radially outwards as a function 
of field angle while the local optical axis 18 is inckJent normal to the plane of the photosensor array 20. To be noted is 
that tile opaque mask 16 acts as the aperture stop for the system as welt as limiting the fiekJ of view of a given photo- 
sensor 



Figs 3B. 3C. 4B. 4C, 5B. and 5C, represent the tangential and sagittal ray aberration curves for their respective 
lenslets. The solid lines represent a wavelengtii of 546.1 nm, the dotted lines represent a wavelengtii of 656.1 nm. and 
ttie dotted and dashed lines represent a wavelengtii of 460.0 nm which represent light in tiie green, red, and blue wave- 
35 lengths. 

The focal length of tiie lenslet must be long enough so tiiat when an image Is formed on a given number of photo- 
detector elements tiie angular resolution in tiie sub-group of photodetectors is conparaWe to ttie angular resolution 
achieved by prior art digital cameras. This establishes ttie lower bounds for ttie focal lengtti of ttie lenslet in ttie 2-5 urn 
range for pixels of 3-10 microns in wkith. 
40 The following table lists ttie optical design parameters for ttiree lenslets with an axial ray incdent at 0. 16. and 24 
degrees. Ottier lenslet surface profiles at intermediate fieki angles are derived by interpolating surface data between 
ttie profiles at ttiese f iekl angles. 

45 

0 Degree Reld Lens 
EFL a 3.0 mm 
F/# = 2.0 

50 



Surface No. 


Radius 


Thickness 


Glass 


Object 




Infinity 


Air 


1 Aperture Stop 




2,0 


BK7 


2 


-1.639 


3.0 


Air 
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(continued) 





9unaC6 no. 


Radius 


Tliickness 


Glass 




Aspheric Coeff. 


k s 0.973 


Diffraclh/o 




5 




AD =1.04x10-^ 


Coeff. 


DF5 = -8.4x10*® 






AE = -3.35x102 




DF10 = -8.3x10-® 






AF= 1.17x10-^ 


Element Decenter 


DF14= 1.4x10-3 


10 




AG = -7.75x10-2 


DC = 0.0 


DF21 =4.5x10-^ 










DF27 = -2.3x10-® 




Image 






Air 



IS Example B 



16 Degree ReldLens 
EFL B 3.0 mm 
Fy#B2.0 



3S 



Surface No. 


Itadius 


Thickness 


Glass 


Object 




Infinity 


Air 


1 Aperture Stop 




2.0 


BK7 


2 


-1.602 


3.0 


Air 


2 Aspheric Coeff. 


k = -0.670 


Diffractive 


DF3 =-4.8x10^ 




AD = -7.0x10-® 


Coeff. 


DF5 = -4.7x10"® 




AE = 2.1x10-2 




DF10=. 1.4x10-2 




AF = -5.9x10-® 




DF1 4 =-3.6x10® 




AG = 6.5x10-'* 


Element Decenter 


DF21 =-5.2x10® 
DF27 =6.2x10-^ 
DC = -0.513 


Image 






Air 



Example C 

45 24 Degree Held Lens 
EFL = 3.0 mm 
F/#»2.0 



Surface No. 


Radius 


Thickness 


Glass 


Object 




Infinity 


Air 


1 Aperture stop 




2.0 


BK7 


2 


•1.509 


3.0 


Air , 
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(c»rrtinued) 



Surface No. 


Radius 


Thickness 


Glass 


Aspheric Coeff. 


k = -0.570 


Diffractive 


DF3 = 7.8x10"^ 






\jOQn. 


Uro = O.ZX 10 




AF = 9.5x10*^ 




DF10 = 1.0x10-2 




AG = -1.2x10-3 




DF14 = -6.3x10-2 




AH = 1.4x10'^ 


Bement Decenter 


DF21 = -2.9x10-3 
DF27 = 7.3x10-^ 
DC =» -0.872 


Image 






Air 



where the aspheric surfece profile is defined by 

z{r)= — p^i==+ADr%AEr^+AFr%AGr^°+AHr^^ 
1+Vl-(kf1)cv^^ 

and the diffractive phase profile is defined as 

= f^(DF3 x' + DFg + DF^o x^ + DF^^ y^ + DFg, x^ + DFg^ y^) 



where . 

30 

Xo3 546.1nm 

Although the lenslet array can operate at low F/#*s (F/2.0), it is advantageous to minimize the lenslefs diameter 
(increasing F/if) so as to minimize the space between lens elements and therefore the image sensor's overall dimen- 
35 sions. If one can achieve higher photo-signal gain with local signal processing electronics, lenslets with smaller numer- 
ical apertures can be used to generate the same level of photocurrent This is accomplished by utilizing a multiplying 
current mirror. 

The illumination incident on the photodetector array from a given lenslet is proportional to the (F/IQ^ Therefore, if 
the sensitivity is increased by x. the F/# can be reduced by x^^. For instance, if an array optic camera, without a mutti- 

40 plying cu^ent mirror is used with a lenslet having a F/# = 4.0 and a FL = 3.0 mm, the lenslefs diameter would be 750 
pm. Therefore, if an an-ay optic camera is formed with 780 by 640 pixels the length of the long dimension of the array 
would be 58.5 mm, assuming an array of 10X10 photodetector elements in each sub-array This wouW require a large 
area of silicon per photosensor array which would increase part costs and result in lower yields of photosensors from a 
given wafer size. By incorporating a current mirror with a multiplication factor of 16 at each sub-array of photodetectors, 

45 the lenslet diameters can be reduced by 4x to 1 87 ^ and the length of the array will be reduced to 14.6 mm, resulting 
in higher photosensor yields and lower part costs. A digital camera can utilize this technique with little decrease in usa- 
ble photosensitive surface areas since the space between each sub-group of photodetectors is not utilized for light 
detection. In optimizing the design of the camera, the area between sub-groups of photodetectors can be minimized to 
allow space only for the necessary support circuitry 

so The extra area between the sub-groups of photodetectors may be used for the incorporation of analog circuitry, 
sub-image pixel inverters, and from 1 to n non-volatile memory cells. The larger the number of memory cells, the larger 
the number of images that can be stored. The use of appropriate memory (for instance, flash memory) allows for the 
storing of image data even when the power to the camera is turned off. It is also possible to use DRAM memory at the 
photosites given that it is acceptable to include refresh circuitry DRAM memory can be constructed using less surface 

ss area which allows for either a smaller distance between the sub-groups of photodetectors or more area for the storage 
of more image data. 

Referring to Fig. 6, the photodetector element 24 may incorporate a CCD de\^ce and/or a photodiode. The output 
of the photosensitive detector 64 is connected to a transfer gate 65 and to a reset gate 66. The output of the transfer 
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gate 65 is connected to the current mmr 30A through multiplexing and clocking circuitry 80. The transfer gate 65 
aRows the charge, accumulated by the photosensitive detector 64 during the exposure period, to be transferred to the 
multiplying current mirror 30A at the desired time by the multiplexing and clocking circuit 80. When closed, the reset 
gate 66 altows for the emptying of the photosensitive element's accumulated charge from the previously completed 

5 exposure. When the reset gate 66 is opened and the cam^a's mechanical shutter is closed (or current from an 
opaquely masked photodetector is used), the output from the photosensitive detector 64 is integrated for a time equiv- 
alent to the previous exposure time so as to cancel dark cun-ent and noise. This cancellation occurs vwthin a correlated 
double sampling circuit (CDS) 40. The integrated signal from the CDS circuit 40 is digitized by an analog-tOKligital con- 
verter 56 and the resulting digital value is processed by the sub-image pixel inverter 48 and then stored in a non-volatile 

w memory 58, which may be a SRAM memory. The digital value can be output to the main data bus 50 by accessing the 
unit siA)-array through row and column address decoders 60 and 62. respectively The image data may be stored at site 
and/or downloaded after each capture. The photosensor array 20 is then ready for exposure to a new image. Each pho- 
todetector element 24 In a sub-group of photodetectors 22 is connected to an individually assigned input to the multi- 
plexing and clocking circuit 80. In operation then, the ou^)uts from each photodetector element are serially connected 

IS (one at a time) to the current mirror 30A. 

As is well known, the output of the current min-or 30A is a multiple of the current produced by the photodetector 
element 24. The current multiplying effect Is traditionally accomplished eitfier by connecting the bases or gates of tiie 
transistors 32i through 32n in parallel with each otiier or by making the emitter (or source) areas larger by an integral 
multiple of the emitter area of an input side transistor 34. Current mirrors of this type operate on ttie principle that the 
20 emitter base voltage (or ttie gate source voltage) for all ttie transistors in ttie current n^Vror are ttie same so ttiat each 
of ttie collector (drain) currents is ttie same and ttierefore ttie sum of ttie cun^ents from the output side is a multiple 
of either ttie number of transistors in ttie output side or tfie ratio of ttie area. This cun-ent multiplication is represented 
mathematically as follows: 

25 I -n*\ 

'otrt-" 'in 

vk^ere 

n number of transistors on ttie output side "To" of ttie cun'ent min-or 
.30 or 

n = Aom/A^,=ttie ratio of emitter areas 



Witti detailed analysis it can be shown that output current is not as simple as the above equation and is more 
rately represented by 

35 

»out = n*(l|n/0+P)) 

where 



p = transistor current gain (typically between 50 and 200) 

In anottier embodiment of the cunrent min-or 30A, a transistor 36 can be added to the irput side Tj of the current 
min-or to drive the bases (or gates) of the output side To of ttie current mirror and ttiereby reduce ttie effects of leakage 
current. This is known to reduce ttie non-kleality of ttie above equation to 

lou, = n*(l|n/(1+p')) 

The output of ttie current minror 30A is switched between two cun-ent amplifiers, amplifiers 42 and 44, wrtti gains of 
+1 and -1 , respectively When ttie photosensitive detector 64 is receiving incident light its amplified current is switched 
through ttie +1 gain of amplifier 42 into an integrating amplifier 46 for a given amount of time and ttien after ttie shutter 
IS closed ttie current is integrated ttirough ttie -1 gain of amplifier 44 for an equal amount of time. This operation is 
known as dual slope, correlated double sampling, and it eliminates ttie effects of dark current and KTC noise, ft differs 
from dual sanple CDS in ttiat ttie signal is switched ttirough two different anplifiers depending on whettier the signal 
represents ttie image data or ttie background data wherever dual time CDS uses the same amplification chain. Corre- 
lated double sampling also reduces Johnson noise, flicker noise, and 1/f noise. A similar effect can be achieved by inte- 
grating the current from an opaquely masked photodetector through ttie -1 gain of amplifier 44. Using an opaquely 
masked photosensor adjacent to the active photosensitive detector 64 allows ttie correlated double sampling technique 
to be implemented in parallel and decreases readout time. The integration of the outputs of the current amplifiers 42 
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and 44 occurs simultaneously, thus eliniinating the need to wait for two integration periods to have output data. How- 
ever, since separate photosensors are used, small differences in dark current and noise can arise between them. 

The integrated signal from the photosensors is then digitized by an analog-to-digitai converter (ADC) circuit 56. 

The output of the ADC is stored in the memory cells 58 after inversion by the sub-image pixel inverter 48. It is also 
possible to assign a group of memory cells to each sub-group of photodetectors 22. 

The image at each sub-array of photodetectors is inverted with respect to the other sub-arrays, therefore, means 
for Inverting the image at the sub-array are incorporated in one en^odiment as a sub-image pixel inverter 48. This 
means will consist of mapping the data from one photodetector to a memory locatfon corresponding to a pholodetector 
at a point which is a min-or image of the object reflected about the center of the sub-array. It is also an embodiment of 
the invention to have the sub-array images inverted by external circuitry or by means of digital image processing. 

This allows the resulting sub-images from each sub-group of photodetectors to be stitched together to form a larger 
composite image. The invention utilizes digital image capture and processing to elinrunate the need for an additional 
array of relay lenslets to invert the sub-images formed by each lenslet. It also eliminates the need for a third array off 
field lenses that would be used to maintain illumination uniformity across the lenslets field of view. 

The stored digital pixel data is accessed by strobing the memory cells 58 via row and column address decoders, in 
order to send data to the data bus 50. The incorporation of the row and column address data lines allows for addressing 
of siteections off the photosensor an-ay 20 for more rapid image readout in a specific area of interest in the image. This 
Is useful in digital cameras which monitor a scene and are only interested in updating the section of tiie image associ- 
ated with moving objects. 

Referring now to Rg. 7. a cun^ent min^or circuit SOB that may be substituted for the cunrent mirror 30A, provides a 
second variant of the current mirror function by utilizing an output transistor Tq emitter or source whose area is n times 
the area of the emitter or source off the input transistor T|. This forms a smaller circuit which in turn allocates more area 
to the sub-groi?) off photodetector 22. Current mirror 30B would be substituted for the cunrent mirror 30A at the connec- 
tion point marked with a circled A. 

Rg. 8 illustrates another variant of a current mirror labeled 30C that is connectable to an associated multiplexing 
and clocking circuit 80 of Rg. 7 at tiie A labeled point marked with a circle In place of either current mirrors 30A or 30B. 
The cunrent mirror 30C achieves current multiplication by biasing the emitter base (or gate source) voltage higher on 
the input side of the current mirror than on the output side. This, more specifically, is accomplished by adjusting the 
value of R1 and R2. Alternately, a diode junction can be substituted into tiie emitter or source off the Input side of the 
current mirror 30C In order to provkie a ffixed voltage bias. 

For a bipolar implementation off the multfplying current minror. this technk^ue can be Hlustrated by the ebers-mdl 
relation, which Is given by 

where 

Vbei=Vb«, + 0.060 V 

allows for a current multiplication off approximately 1 0 x at 300 k. 

In operation, data ffrom a subsection of an array can be accessed by using only those addresses tiiat represent the 
location of data of interest. In tfiis fashion segments of a captured image may be clocked out more rapkily in oider to 
view areas that are capturing rapkJ scene changes while sampling less active areas less frequentiy. 

If more than one image is stored at each sub-group of photodetectors 22, the length of tiie addresses are increased 
accordingly to allow individual access to each of the multiple image data words (pixel image data). 

Referring next to Rg. 9, an o^ed 90 (anrow) is imaged onto sub-groups of photodetectors 22. Each lenslet 12 
views a different segment off the field of view. As a result, the segment 1-3 of the anrow forms an inverted Image 92A 
that impinges on its respective sub-group of photodetectors 22. Likewise the segment 3-5 of the arrow 90 fonns an 
inverted image 92B tiiat impinges on Its respective sub-group of photodetectors 22. The same holds true for tiie seg- 
ment 5-7 forming the inverted Image 92C. Noted in ttie drawing is that the images 92A tiirough 92C do not form, from 
left to right, a continuous image of the arrow 90. More specifically, note that point 1 1s adjacent point 5 and that point 3 
is adjacent point 7 at tiie surfaces of the sub-group of photodetectors 22. That is, if the sub-images of tiie arrow 90 were 
simply stitched together, the overall mosaic (composite) image wouM be scrambled and unusable. 

To arrange the pixel image data in proper order the charges fomi the matrix of photodetector elements 24 in each 
sub-group 22 are first clocked out and multiplexed through tiielr respective current multiplying circuit, correlated double 
sampling circuitry, and digitized by the ADC, The digital data from a pixel, representing an image, In each sub-group of 
photodetectors 22 is positfonally inverted witti respect to ttie center of each sub-grtoup of photodetectors 22. Therefore, 
a sub-image pixel inverter 48 is needed to take ttie pixel data from a pixel located at point A and to store it in a memory 
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cell 58 which is inverted with respect to the centra! pixel of the sub-group of photodetedorsw For exanple. pixel A wouW 
be stored in the memory 58 at a location con'esponding to D. The overall mosaic composite image Is then built up for 
use by an output device 1 1 0. such as a printer or CRT display, by reading the first row from the first sub-image and then 
adding the first row of the next sub-image till the first rows have all been clocked out. Next the second row from the first 
5 image is clocked out and the process continues until the mosaic image Is completed with the last pixel being stored in 
memory location I. 

In summary then, the overall image pixel data is generated from the array of sub-groups of photodetectors by dg- 
itally stitching the sub-images back together to form a composite image. This is accomplished k>y taking the row data 
from each sub-Image in turn and adding it to the row data for the next sub-image until the end of the an^ay Is reached. 

10 Then the address for the next column of row data, at the farthest point on the an-ay, is used to start building the next row 
of image data by adding the row data from the next subnmage until the end of the line of sub-an-ays is reached, at which 
point the address pointer moves to the beginning of the next column. In some embodiments it may be useful to have 
some image overlap from one sub-array to the next. This woukJ require the address decoding technique to be able to 
determine which location in a sub-array row is to be used as the first pixel from that row. 

IS The inventkH) has been desaibed with reference to prefenred embodiments. However, it will be appredated that 
variations and modifications can be effected by a person of ordinary skill in the art without departing from the scope of 
the inventk>n. 
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Claims 



1 . A compact digital camera, comprising: 

a lenslet array comprised of a plurality of lenslets, eadi lenslet having a decentration corresponding to its radial 
position in the lenslet anray so that the axial ray of each lenslet views a different segment of a total field of view; 
a photosensor array comprised of a plurality of sub-groups of photodetectors, each sub-group positioned along 
the axial ray of a respective lenslet; and 

a field limiting baffle comprised of at least one aperture plate where the center of the apertures are positioned 
to lie along the axial ray of a respective lenslet. 

2. A compact digital camera, comprising: 

a lenslet array comprised of a plurality of lenslets. each lenslet having a decentration corresponding to Its radial 
position in the lenslet array so that the axial ray of each lenslet views a different segment of a total field of view; 
a color photosensor array conprised of a plurality of sub-groups of photodetectors wherein each subgroup of 
photodetectors is comprised of sets of Red. Green, and Blue color sensitive photodetectors, each sub-group 
of photodetectors being positioned along the axial ray of a respective lenslet; and 
a field limiting baffle comprised of at least one aperture plate where the center of the apertures are positioned 
to lie along the axial ray of a respective lenslet. 

3. A compact image capture device comprising: 

an an-ay of spaced apart sub-groups of radiation sensors for providing output signals that are a function of the 
incident radiation from an Image onto each radiation sensor of a sub-group; 

anray electronics dispersed in the spaces between the spaced apart sub-groups of radiation sensors for receiv- 
ing the provided output signals so as to amplify, digitize, invert, and store, the provided output signals to facili- 
tate im^e capture; and 

a lens array positioned so as to focus the radiation of an image to be captured onto said radiation sensors. 

4. A compact image capture device according to Claim 3 wherein said array electronics is comprised In part of: 

a plurality of current muftipliers, corresponding in number to the number of sub-groups of radiation sensors, 
each connected to a respective sub-group for receiving tiie outputs of the radiation sensors in the sub-groi^;' 
a corresponding plurality of analog-to-digital converters, each connected to an assodated current multiplier; ' 
a con-esponding plurality of inverters for digitally inverting the sub-images from said analog-to<ligital convert- 
ers; and 

a corresponding plurality of storage devices connected to receive the digitally inverted sub-images from con-e- 
sponding inverters for storing the provided digitally inverted sub-images. 

5. An Image capturing device comprising: 

an an-ay of spaced apart groups of radiation sensors for providing output signals that are a function of the color 
of incident radiation from an image onto each radiation sensor; 

anray electronics dispersed in the spaces between the spaced apart groups of radiation sensois for receiving, 
amplifying, digitizing, inverting, and storing the provided output signals; and 

a lens array positioned so as to focus the radiation from an image to be captured onto associated ones of the 
radiation sensors in each of the groups of said radiation sensors such that each radiation sensor In a group 
provides an output signal that is stored as a function of the color of the sensed radiatfon. 

6. A photosensor array of spaced apart sub-groups of cunrent generating photodetectors each sub-group in combina- 
tion witti an associated multiplying current mirror located adjacent thereto and comprised of one input transistor 
and at least two output transistors where the generated photocurrent from each photodeteclor is multiplied by an 
integer equal to the number of output ti-ansistors in the associated multiplying current mirror witti the output of the 
current mirror being fonwarded to a digitizing. Inverting, and storing means, located adjacent to an associated cur- 
rent minor, fbr storage. 

7. The photosensor array according to Claim 6 and further comprising: 
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a lenslet array having a number of lenslets corresponding in number to the nurrtber of sub-groups of cun-ent 
generating photodetectors, each lenslet positioned so as to focus Incident radiation onto an associated sub- 
group of cunrent generating photodeteclors. each lenslet being a refractive/drffractive lenslet wherein the 
center of the mechanical optical axis of each lenslet is displaced relative to the displacement of its associated 
sub-group of current generating photodetector's radial distance from the optical axis of the lenslet located in 
the center of the photosensor array. 

8. A photosensor array of spaced apart sub-groups of current generating photodetectors each sub-group in combina- 
tion with an associated multiplying current min'or located adjacent thereto and conprised of one input transistor 
and at least one output transistor where the emitter base voltage on the input transistor is biased to produce an 
integer multiple of the input current at the output transistor's emitter corresponding to a sub-image; 

a correlated double sanpling circuit connected to receive the sub-image signals of an associated multiplying 
cunent min-or for providing a sub-image output that minimizes the dark current and noise from the cun-ent gen- 
erating photodetectors; 

digitizing means for digitizing the sub-images from said con-elated double sampling circuits; 
inverting means for digitally inverting the sub-images from said digitizing means; 
storage means for storing the digitally inverted sub-images from said inverting means; 
a data bus; and 

row and column select means for connecting the storage means to said data bus lor outputting selected digit- 
ally inverted sub-images. 

9. A compact digital camera, comprising: 

a lenslet array comprised of a plurality of lenslets, each lenslet having a decentration con-esponding to its radial 
position in the lenslet array so that the axial ray of each lenslet views a different segment of a total field of view; 
a photosensor array comprised of a plurality of spaced apart sub-groups of photodetectors, each sub-group 
positioned along the axial ray of a respective lenslet for providing output signals as a function of incident light: 
electronic circuits formed in the space between the spaced apart sub-groups and connected to receive, 
amplify, and invert the output signals provided by the photodetectors; 

a field limiting baffle comprised of at least one aperture plate having a plurality of apertures, corresponding in 
number to the number of lenslets, where the center of each aperture is positioned to lie along the axial ray of 
a respective lenslet; and 

means for receiving the amplified and inverted output signals from said electronic circuits and for stitching the 
output signals together so as to enable the viewing of a continuous image when the stitched output signals are 
used to drive an output display device. 

10. The compact digital camera according to Claim 9 and further conprising: 

storage means formed in the space between the spaced apart sub-groups of photodetectors for storing the 
amplified and inverted output signals from said electronic circuits. 
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